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ABSTRACT 

^ * V This paper reports on the results'of sevexj questions 

asked to secondary level department chairmen regarding the ilnit^tests 
which accompany textbook materials. Nearly 1, SOO^responses- were 
received from teachers of ^French, German, and Spanisjii. The results 
indicate that most^eachers do not use publishers tests when they are 
^available. The questionnaire also investigates attitudes toward 
"^objective tests, and/ the' optimum length' Of unit tests .and the final 
examination, and analyzes differences in attitude amon'g teachers o£ 
the. three laiiguages. (Author) / * * 
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tEACHERS' ATTITUDES TOW^D PUBLISHERS' TESTS 
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Since the latter half of the 1960's, it has bei&n .customaiy for 

• ' ' ' / 

coinmerciaX publishers to issue a series of classroom tests to accompany 
their textboic>k- materials. I have found the reaction to these to 

■ c ■ 

be mostly favorable among those who use them, especially during the 

O 4 ' 

firs£' couple o? years emarso long as the students perform fairly well. 
Yet, a look at the supplementary tests published by such com-gan^es ^ 
as Holt, Rinehart, and Winston; Harcourt, Brace and Jovanovich; 
Macmillan; Hand McNally; Houghton-Mifflin; and McGraw-Hill, chows 
considerable differences in style, and format. Some are limited to 



objective type items which can be easily scored. Others contain 
non-objective items almost exclusively. Some tests only assess 
reading and writing, while others assess listening, reading, and 
writing, and, some assess all four skills^ Some tests contain only 
20 items while others contain 60 or more. 

.When a publishing house develop^ a new series of materials, 
perhaps th« major question it fjices is onp of finances.. Given an 
unlimited sales potential, it coMd develop supplementary materials 
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of all kinds. But today editors know that enrollments are do>jn, 

'I • . - • s ' ' ■•- 

the competition is fierce, and money fpr purcl>asing is limited, with ' 
th6 result that it is' nece8S9,"ry to make ' early but -critical 
decisions as to which' anc-illary materials are essential to the sale 
.of a text, and which' are not. In- short, the publisher is frequenifly 
faced with a dilemma: teachers request that qH kinds of materials 
be 'developed, but frequently do not purchase- them if they are. 
Examples of such supplementary materials' include teacher's manuals, 
teacher's editions of the text, vocabulary cards, workbooksi, "laboratonr 
manuals, individualized study guides, transparencies, filmBtr3,ps, 
dialog p<^9t era, l6 mm. films, separate readers, reel-to-reel tapes, 
cassette tapes, and unit teats. 

In order to resolve this 'problem, at least one publisher. Holt, 
Rinehart, arid Winston, has been wise enough to conduct a scientific 
survey of the foreign language teaching population. 

In the Spring of 197U, this writer chaired a. team which developed 
a 125 item questionnaire for teachers on high school foreign, language , 

materials. Other membprs of the committee included: Mary Sexton, a 

] • • 

teacher of French" aVUanunj High School 'in Denver; Doctor Arno Preller, 

/ 

professor of German at Colorado State University in' l^rt Collins; 
'-and Roy Gabriel, aN^.D'. candidate in E!ducational Research at the 
University Of Colorado in Boulder.. The committee met all d^y for 
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five consecutive Saturdays in ord6r to ^eveloD its survey instrupient 

It. was ^pretested on ten foreign language teachers at differeji;b iSiphools 

in the Denver ^area, l6y having each read and respond to all items. 

■ . ... X 1^ i 

A committee member was present to answer any questions ^or^jclarify any * 



matters which Qeeiiied uncleay, after 'which the member took notes on the 

problem for discussion at the final meeting. Following some brief 

. ' ■ ■ , \ ' 

revisions and a second pretesting on three more teachers, ^le instrumen;! 

was printed by the "publisher and mailed to 3,500 secoadary- schb^l 

department- chairmen throughout the country on April' 19 » 197^. . A 

^ ■ • - ^ ' ' ' ' '-•/ 

business ^bply envelope, separate mark-sense answer sheet," and/number 
two Qoft-leei'd pencil were also included in the packet. Of the 3,500 
questionnaires sent, 1,U2U were returned to tjie publisher^ The data, 
were then tbLLlied by computer and the results displayet^ oh a computer 
printout, / ' 

/ -f. 

Although the main corpus of the results must Remain confidential, 
I can report io you on the responses to the sev^h questions concerning 
supplementary teotq. . ^ 



RESULTS 

• -tp 

<^ 

Perhaps most surprising to testinpc /specialists and pubXi^ers 
^ alike is the finding that 2/3 of the teachers claim that they^never 
use any teoto they have not thera&eiyes prepared. In response to the 



5 



/ 

/ 




question, "How fyequentiy do you i)repare your ''own' t.ests?" , 6?/^ marked 

✓ " \- . ' ' • . ^ . 

oivays , 28J{ oomet'imes , 2J5 rarely , and 1^ ngver. The reliability df this * 

response is corroborated by another ^tem of the ^ quest ibnnaire which 

■• . ' * 

aaks teachers to rank' in o^er of importance "bhe following supplementary 
materials t l^apes; workbook, guide to^ individualization, teachers' 
jaanuol, andTtests. '.On this it/em, testa were ranlted fourth, sfollowed^ 
by the guide to individualization. Adc^^itional fcorroborat'ipn is found 

in a l^ater item which asked the teachers to rank the same publishers ' 

I' ■ ■ ' 
materials in frequency of use. Here again, the same order prevailed. 

It is interesting to notes' that only 30% of the German teachers responded > 
glvayo to this question. have no satin fnctory oxpianatlon. to offer 
for this dlocropaney but it eloao appear tflat Oormnn toaohorn nro more 
Iike4.y to make mo of publishers' tests than teachers of French or , • 
' Spaiiish. ^ 

Another item which might illuminate this matter asks ^he question ^ 
"How essential to a series do you consider publish^ers' supplementary 
testQ^4iP "be?" with the options being very essential , somewhat ^asential. , 

not esseii^iaiV vand I woul4 not use them . While the inodal response for 
• ^^'^^^ * * • • 

all languages was som^hat essential , 285? of the Gorman teachers 

reoTionded verv essential as coi|iparea to 19% of the French and Spanish 
teachers. ^ , . • 



Auth<sSrs of textbooks on tesMng, especially Rebecca valet^e5 have, 
for,J^3|e past 50 years, been promoting the "new type'' or ob^lective test 

il^^"^, which can be* more 'roliably scorned; One advantage of such tests 

* ' ' ' ' 

when -applied tOv foreign languages is that they 'do not require students 

to wast»e time rewriting entire se|itetices when the instructor is only 

interested in .grading for a particular learning problem such as verb, 

/ 

t> * . " . » 

object pronoun, or adjective placement. Because of this, with the" 
• • ' / 

objective/i test it is possible to giva.vtbe student a greater number of. 

'I ' ' . ' '/ ^ • ' 

items in lihe seone amount of time, which, j of course, acts f avorabljp^ on 



the queeltibn .of content- validity ."^^ 



InflMiie of the prestigous position occupied by objective tes-^s in 
American education, and their apparent 



r 

a^vantap:es, the foreign language 



departjiient chairmen surveyed rejected iphem overwhelmingly. In response 
to tha- question "Should publishers' tes|s be^ based on true-false and 
multiple choice items?", Bh% responded /no,, yes , and Q% had no opinion 
Ap:ain, Oerman teacher^ were 'the most decidedly opposed to^uch tests, 
with only reYiponding' jres, and 88$2 responding no . 

The question of test len^h is an interesting one. One frequently 
hears complaints from .teachers that publishers tests are too long, thus 
taking up too much time. Sincfe World War II, the concyept of the short 
^uiz haq become eotablished. Actually the distinction of test versus 
quiz ??xicite^ proviouBly, but under thn pMoq of o■J:nm^ nation vnrtiuq 
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2 » 
test.. At any rate, during the past decades the education profession 

b&3, moved tovp.rd shbrt^r, more- frequent learning assess^nts^ 

P^yehclogists claim thst this io heneficial oince frequent quizzes tend 

to reduce test anxiety. - *^ - 

Nevertheless, the results of the butv^ see^to indicate a q. 

preference for laore lengthy tests. .V/h6n askeS to 'choose the optimum 

length for a puhliohey 's test (20< 30, UO, or 50 minutes), the modal 

-response was UO, which was preferred by h6% of the group'. Here again 

German teachers dif^erdd from their^ coll^^es in that their second ^ 

preference was 'for 50 minute tests, whereas Spanish and. French teachers 

preferred 30 minute over 50 minute .tests by a two-to-one margin. This 

difference of opinion disappears however on the sub.lect of final exams. 

Here, approximately half of all teachers clearly preferred a two-hoiir 

exam, over others of one hour or three hours in lenpcth. Ten percent ^- 

of the teachers said they would not give a final examination.^ 
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CONCLUSIONS . 



It appears that the availability of supplementary tests io not a 
major factor among foreign language department chairmsu in the selection 
of a. textbook, since two-thirds do not even, use them. Moreover, the 

it . ' ' 

eaoQ .and rapidity with which a multiple choice test can be graded 

1 • 

8 



appearo to offer little attraction^ to teach^^rs. Rat}jer, they would 
prefer to construct their o\m tests," and these are generally lengthy, 
■ nearly a* full period lojig, and involve a more complete display of lanf^&ge 
. i competence than the multiple choice test efffers. A^parenfiy , foreign 

^ , language .teachers xrere never- really attracted )3y the idea of testing a 
single linguistic problem ob.lectivefy as described in Lado and Valette, 
but rather they are common users of 'a more integrative' approach to 
' ,langua>;e assessment. It is also probable that teachers pimply prefer to . 
give tho'ir own test*, rather than one constructed by spmeone else. 
Franklv* I doubt that the teacher made test is better than the 
publisher's test in r^eliabi^lity and validity, and :^t if^ probably often 

limited to the 'writing skill alone. Vfhen teacW-^ade speakifig teerts are 

. . ' ' \ k 

•used, Kalivoda has found. them to be lacking in- real communicative activity. 

r , * - ' ■ 

, ' The *t ape recorded listening tests accompanying publishers materials* 

» 

are geridtrally an enjoyable activity for students. Yet, perhaps^ these 
have \^oti discardesd due to the ambiguous pictures frequently us^d as a 
Qtimuluan^ Agaih, it is doubtful that many teachers , design theiri bx-m 
■iisteninr, tests except for the dictation.' 

•J/hO attitudes of German teachers merit further consideration. 

' ■ ■ 1 ■ 

t'Jhile tlioy tend to use publisher's teMs trlth greater frequency, at the 
^'f some tiW<3 'they react more negatively to purely ob.lective measures. 
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Perhaps German teachers- are more united in their reservat^-ons about 

» f 

discre^point. tests, but still feel that publishers', tests 'offer certain 
'advantages which they cannot easily duplicate, i.e., 0%ructured tests of 
I? ^ listening, speaking, and reading. In this same vein, their pi^eference for 
lonf?:er tests tfould seem to be on indication of a more .l^horough approach « ^ 
to assessment. ' — ^ ' 

Since the size of the sample indicates the probable fteneralizeability 
.of the data, this study poses several questions. At this point, research 
needs to be conducted on the type of test* items most teachers prefer, and , 
trhether or not they are concerned with teatinr^ the four skills or evon ^ 
txTo of them. If the results proV^ ne^rative, and I suspoct they mip:ht, 
teacher trainors must return to this problem with roneirod vtpior. Tn the 
final analysis, a test of only one skill is seftiously lacking In validity, . 
^ the most important concern of all: ^ ■ ^ 
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